2025-11-15 10:15:10 [scrapy.utils.log] (PID: 57) INFO: Scrapy 2.12.0 started (bot: catalog_extraction) 2025-11-15 10:15:10 [scrapy.utils.log] (PID: 57) INFO: Versions: lxml 5.3.1.0, libxml2 2.12.9, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 24.11.0, Python 3.11.13 (main, Jun 10 2025, 23:54:42) [GCC 12.2.0], pyOpenSSL 25.0.0 (OpenSSL 3.4.1 11 Feb 2025), cryptography 44.0.2, Platform Linux-6.9.12-x86_64-with-glibc2.36 2025-11-15 10:15:10 [smith_corona] (PID: 57) INFO: Starting extraction spider smith_corona... 2025-11-15 10:15:10 [scrapy.addons] (PID: 57) INFO: Enabled addons: [] 2025-11-15 10:15:10 [py.warnings] (PID: 57) WARNING: /usr/local/lib/python3.11/site-packages/scrapy/utils/request.py:120: ScrapyDeprecationWarning: 'REQUEST_FINGERPRINTER_IMPLEMENTATION' is a deprecated setting. It will be removed in a future version of Scrapy. return cls(crawler) 2025-11-15 10:15:10 [scrapy.extensions.telnet] (PID: 57) INFO: Telnet Password: 6227d86203efb722 2025-11-15 10:15:10 [py.warnings] (PID: 57) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-15 10:15:10 [scrapy.middleware] (PID: 57) INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.closespider.CloseSpider', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats', 'spidermon.contrib.scrapy.extensions.Spidermon'] 2025-11-15 10:15:10 [scrapy.crawler] (PID: 57) INFO: Overridden settings: {'BOT_NAME': 'catalog_extraction', 'CONCURRENT_ITEMS': 250, 'CONCURRENT_REQUESTS': 24, 'DOWNLOAD_DELAY': 1.25, 'FEED_EXPORT_ENCODING': 'utf-8', 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_extraction/smith_corona/f4ea45e8c20b11f09c134200a9fe0102.log', 'LOG_FORMAT': '%(asctime)s [%(name)s] (PID: %(process)d) %(levelname)s: ' '%(message)s', 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'catalog_extraction.spiders', 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter', 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7', 'RETRY_HTTP_CODES': [500, 502, 503, 504, 522, 524, 408, 429, 403], 'RETRY_TIMES': 5, 'SPIDER_MODULES': ['catalog_extraction.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor', 'USER_AGENT': None} 2025-11-15 10:15:11 [scrapy_poet.injection] (PID: 57) INFO: Loading providers: [, , , , , , ] 2025-11-15 10:15:11 [scrapy.middleware] (PID: 57) INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scraping_utils.middlewares.downloaders.ProxyManagerDownloaderMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scraping_utils.middlewares.downloaders.HeadersSpooferDownloaderMiddleware', 'scrapy_poet.InjectionMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy_poet.DownloaderStatsMiddleware'] 2025-11-15 10:15:11 [NotFoundHandlerSpiderMiddleware] (PID: 57) INFO: NotFoundHandlerSpiderMiddleware running on PRODUCTION environment. 2025-11-15 10:15:11 [scrapy.middleware] (PID: 57) INFO: Enabled spider middlewares: ['catalog_extraction.middlewares.NotFoundHandlerSpiderMiddleware', 'catalog_extraction.middlewares.FixtureSavingMiddleware', 'scrapy_poet.RetryMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2025-11-15 10:15:11 [scrapy.middleware] (PID: 57) INFO: Enabled item pipelines: ['catalog_extraction.pipelines.DuplicatedSKUsFilterPipeline', 'catalog_extraction.pipelines.DiscontinuedProductsAdjustmentPipeline', 'catalog_extraction.pipelines.PriceRoundingPipeline', 'scraping_utils.pipelines.AttachSupplierPipeline', 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline'] 2025-11-15 10:15:11 [scrapy.core.engine] (PID: 57) INFO: Spider opened 2025-11-15 10:15:11 [scrapy.extensions.closespider] (PID: 57) INFO: Spider will stop when no items are produced after 1800 seconds. 2025-11-15 10:15:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-11-15 10:15:11 [scrapy.extensions.telnet] (PID: 57) INFO: Telnet console listening on 127.0.0.1:6025 2025-11-15 10:15:13 [ProxyManagerDownloaderMiddleware] (PID: 57) INFO: Using brd-customer-hl_13cda1e4-zone-sharedpool_datacenter_proxy as the default proxy for ProxyManagerDownloaderMiddleware. 2025-11-15 10:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-3-inkjet-roll-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-thermal-transfer-labels-3-core.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-xl-film-liner.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/36-pack-2-x-110-clear-1-6-mil-carton-sealing-tape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-25-x-1-25-sheet-labels-92.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-0-375-sheet-labels-112.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-3-5-sheet-labels-200.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-75-x-4-75-sheet-labels-203.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-64-x-4-64-sheet-labels-595.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-826.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-fanfold-labels-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-fluorescent-red-xs.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-thermal-transfer-labels-3-core-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-thermal-transfer-labels-3-core-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/58mm-x-93mm-blank-bizerba-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-4-direct-thermal-labels-3-core.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-inch-x-4-5-inch-blank-hobart-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-1-direct-thermal-labels-1-core-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-light-blue.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-x-1-25-thermal-transfer-labels-1-core-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-hot-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-3-inkjet-roll-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-thermal-transfer-labels-3-core.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-xl-film-liner.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/36-pack-2-x-110-clear-1-6-mil-carton-sealing-tape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-25-x-1-25-sheet-labels-92.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-0-375-sheet-labels-112.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-3-5-sheet-labels-200.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-75-x-4-75-sheet-labels-203.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-64-x-4-64-sheet-labels-595.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-826.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-fanfold-labels-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-fluorescent-red-xs.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-thermal-transfer-labels-3-core-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-11-15 10:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-thermal-transfer-labels-3-core-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/58mm-x-93mm-blank-bizerba-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-4-direct-thermal-labels-3-core.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-inch-x-4-5-inch-blank-hobart-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-1-direct-thermal-labels-1-core-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-light-blue.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-x-1-25-thermal-transfer-labels-1-core-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-hot-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-3-inkjet-roll-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-thermal-transfer-labels-3-core.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-xl-film-liner.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/36-pack-2-x-110-clear-1-6-mil-carton-sealing-tape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-25-x-1-25-sheet-labels-92.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-0-375-sheet-labels-112.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-3-5-sheet-labels-200.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-75-x-4-75-sheet-labels-203.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-64-x-4-64-sheet-labels-595.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-826.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-fanfold-labels-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-fluorescent-red-xs.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-thermal-transfer-labels-3-core-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-thermal-transfer-labels-3-core-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/58mm-x-93mm-blank-bizerba-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-4-direct-thermal-labels-3-core.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-inch-x-4-5-inch-blank-hobart-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-1-direct-thermal-labels-1-core-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-light-blue.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-x-1-25-thermal-transfer-labels-1-core-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-hot-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-3-inkjet-roll-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-thermal-transfer-labels-3-core.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-xl-film-liner.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/36-pack-2-x-110-clear-1-6-mil-carton-sealing-tape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-25-x-1-25-sheet-labels-92.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-11-15 10:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-0-375-sheet-labels-112.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-3-5-sheet-labels-200.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-75-x-4-75-sheet-labels-203.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-64-x-4-64-sheet-labels-595.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-826.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-fanfold-labels-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-fluorescent-red-xs.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-thermal-transfer-labels-3-core-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-thermal-transfer-labels-3-core-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/58mm-x-93mm-blank-bizerba-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-4-direct-thermal-labels-3-core.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-inch-x-4-5-inch-blank-hobart-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-1-direct-thermal-labels-1-core-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-light-blue.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-x-1-25-thermal-transfer-labels-1-core-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-hot-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-3-inkjet-roll-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-thermal-transfer-labels-3-core.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-xl-film-liner.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/36-pack-2-x-110-clear-1-6-mil-carton-sealing-tape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-25-x-1-25-sheet-labels-92.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-0-375-sheet-labels-112.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-3-5-sheet-labels-200.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-75-x-4-75-sheet-labels-203.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-64-x-4-64-sheet-labels-595.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-826.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-fanfold-labels-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-fluorescent-red-xs.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-thermal-transfer-labels-3-core-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-thermal-transfer-labels-3-core-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/58mm-x-93mm-blank-bizerba-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-4-direct-thermal-labels-3-core.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-inch-x-4-5-inch-blank-hobart-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-1-direct-thermal-labels-1-core-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-11-15 10:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-light-blue.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-x-1-25-thermal-transfer-labels-1-core-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-hot-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:17 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:18 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-3-inkjet-roll-labels.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:19 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:19 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-1-thermal-transfer-labels-3-core.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:21 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:21 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-xl-film-liner.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:23 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:23 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/36-pack-2-x-110-clear-1-6-mil-carton-sealing-tape.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:24 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:24 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/1-25-x-1-25-sheet-labels-92.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:26 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:26 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/1-x-0-375-sheet-labels-112.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:28 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:28 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/8-5-x-3-5-sheet-labels-200.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:29 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:29 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/3-75-x-4-75-sheet-labels-203.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:31 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:31 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/4-64-x-4-64-sheet-labels-595.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:33 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:33 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/1-x-1-sheet-labels-826.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:34 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:34 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-6-thermal-transfer-fanfold-labels-orange.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:35 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:35 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-fluorescent-red-xs.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:36 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:36 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-orange.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:38 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:38 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/1-5-x-1-thermal-transfer-labels-3-core-grape.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:39 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:39 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/1-5-x-1-thermal-transfer-labels-3-core-purple.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:41 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:41 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/58mm-x-93mm-blank-bizerba-labels.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:42 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:43 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-4-direct-thermal-labels-3-core.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:44 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:44 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/2-25-inch-x-4-5-inch-blank-hobart-labels.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:46 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:46 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/2-x-1-direct-thermal-labels-1-core-top-coated.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:48 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:48 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-purple.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:49 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:49 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-6-direct-thermal-labels-light-blue.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:50 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:50 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/2-25-x-1-25-thermal-transfer-labels-1-core-fluorescent-red.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:52 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:52 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-fluorescent-green.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:53 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 10:18:53 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-hot-pink.html>: HTTP status code is not handled or not allowed 2025-11-15 10:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-blue.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-1-thermal-transfer-labels-1-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-fanfold-labels-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-5-thermal-transfer-fanfold-labels-chartreuse.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-1-direct-thermal-labels-1-core-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-freezer-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-6-thermal-transfer-labels-3-core-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-ups-tab.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-6-thermal-transfer-labels-3-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-2-thermal-transfer-labels-1-core-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 24 pages (at 24 pages/min), scraped 0 items (at 0 items/min) 2025-11-15 10:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-5-direct-thermal-labels-0-75-core-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-5-x-1-5-thermal-transfer-labels-3-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-3-direct-thermal-labels-0-75-core-yellow.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-5-thermal-transfer-labels-3-core-nonperforated-fluorescent-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-1-thermal-transfer-labels-3-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-1-thermal-transfer-labels-3-core-chartreuse.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-5-thermal-transfer-labels-3-core-nonperforated-pink-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-5-thermal-transfer-fanfold-labels-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-3-thermal-transfer-labels-3-core-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-polypropylene-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-labels-3-core-nonperforated-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-fanfold-labels-fluorescent-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-labels-1-core-yellow-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-blue.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-1-thermal-transfer-labels-1-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-fanfold-labels-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-5-thermal-transfer-fanfold-labels-chartreuse.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-1-direct-thermal-labels-1-core-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-freezer-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-6-thermal-transfer-labels-3-core-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-ups-tab.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-6-thermal-transfer-labels-3-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-2-thermal-transfer-labels-1-core-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-5-direct-thermal-labels-0-75-core-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-5-x-1-5-thermal-transfer-labels-3-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-3-direct-thermal-labels-0-75-core-yellow.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-5-thermal-transfer-labels-3-core-nonperforated-fluorescent-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-1-thermal-transfer-labels-3-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-1-thermal-transfer-labels-3-core-chartreuse.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-5-thermal-transfer-labels-3-core-nonperforated-pink-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-5-thermal-transfer-fanfold-labels-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-3-thermal-transfer-labels-3-core-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-polypropylene-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-labels-3-core-nonperforated-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-fanfold-labels-fluorescent-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-labels-1-core-yellow-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-blue.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-1-thermal-transfer-labels-1-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 24 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-11-15 10:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-fanfold-labels-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-5-thermal-transfer-fanfold-labels-chartreuse.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-1-direct-thermal-labels-1-core-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-freezer-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-6-thermal-transfer-labels-3-core-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-ups-tab.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-6-thermal-transfer-labels-3-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT3010AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDF4060AP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4080AP-UPS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 55 pages (at 31 pages/min), scraped 6 items (at 6 items/min) 2025-11-15 10:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4065AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 95 pages (at 40 pages/min), scraped 26 items (at 20 items/min) 2025-11-15 10:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6040A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 133 pages (at 38 pages/min), scraped 50 items (at 24 items/min) 2025-11-15 10:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4065AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 174 pages (at 41 pages/min), scraped 73 items (at 23 items/min) 2025-11-15 10:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 212 pages (at 38 pages/min), scraped 88 items (at 15 items/min) 2025-11-15 10:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 249 pages (at 37 pages/min), scraped 102 items (at 14 items/min) 2025-11-15 10:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 290 pages (at 41 pages/min), scraped 127 items (at 25 items/min) 2025-11-15 10:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-x-2-sheet-labels-white-vinyl-drum-735.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-875-x-1-0625-sheet-labels-white-vinyl-drum-868.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 329 pages (at 39 pages/min), scraped 150 items (at 23 items/min) 2025-11-15 10:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-pastel-pink-127.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-sheet-labels-pastel-pink-195.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 364 pages (at 35 pages/min), scraped 163 items (at 13 items/min) 2025-11-15 10:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 401 pages (at 37 pages/min), scraped 180 items (at 17 items/min) 2025-11-15 10:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 439 pages (at 38 pages/min), scraped 202 items (at 22 items/min) 2025-11-15 10:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 479 pages (at 40 pages/min), scraped 223 items (at 21 items/min) 2025-11-15 10:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 519 pages (at 40 pages/min), scraped 243 items (at 20 items/min) 2025-11-15 10:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 559 pages (at 40 pages/min), scraped 260 items (at 17 items/min) 2025-11-15 10:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 599 pages (at 40 pages/min), scraped 279 items (at 19 items/min) 2025-11-15 10:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-HOTPNK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=800*190*300*1000*H already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-DARKBLUE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-POLY-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4013 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0015 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-PINK-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 642 pages (at 43 pages/min), scraped 302 items (at 23 items/min) 2025-11-15 10:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4013A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT3020AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 681 pages (at 39 pages/min), scraped 324 items (at 22 items/min) 2025-11-15 10:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 722 pages (at 41 pages/min), scraped 344 items (at 20 items/min) 2025-11-15 10:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4010AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 760 pages (at 38 pages/min), scraped 361 items (at 17 items/min) 2025-11-15 10:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 800 pages (at 40 pages/min), scraped 380 items (at 19 items/min) 2025-11-15 10:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 839 pages (at 39 pages/min), scraped 402 items (at 22 items/min) 2025-11-15 10:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 878 pages (at 39 pages/min), scraped 423 items (at 21 items/min) 2025-11-15 10:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 918 pages (at 40 pages/min), scraped 441 items (at 18 items/min) 2025-11-15 10:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 958 pages (at 40 pages/min), scraped 460 items (at 19 items/min) 2025-11-15 10:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 999 pages (at 41 pages/min), scraped 480 items (at 20 items/min) 2025-11-15 10:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1037 pages (at 38 pages/min), scraped 501 items (at 21 items/min) 2025-11-15 10:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1075 pages (at 38 pages/min), scraped 521 items (at 20 items/min) 2025-11-15 10:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1116 pages (at 41 pages/min), scraped 539 items (at 18 items/min) 2025-11-15 10:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1155 pages (at 39 pages/min), scraped 557 items (at 18 items/min) 2025-11-15 10:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1192 pages (at 37 pages/min), scraped 578 items (at 21 items/min) 2025-11-15 10:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0512*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9380 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1233 pages (at 41 pages/min), scraped 600 items (at 22 items/min) 2025-11-15 10:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT5030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4065AP-2X already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3100AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSC0002 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP-ORG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1271 pages (at 38 pages/min), scraped 618 items (at 18 items/min) 2025-11-15 10:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT2515AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3030AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1309 pages (at 38 pages/min), scraped 634 items (at 16 items/min) 2025-11-15 10:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4012AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1350 pages (at 41 pages/min), scraped 655 items (at 21 items/min) 2025-11-15 10:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4050AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-9-thermal-transfer-labels-3-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-9-thermal-transfer-labels-3-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT5030AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1384 pages (at 34 pages/min), scraped 675 items (at 20 items/min) 2025-11-15 10:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1424 pages (at 40 pages/min), scraped 696 items (at 21 items/min) 2025-11-15 10:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1463 pages (at 39 pages/min), scraped 712 items (at 16 items/min) 2025-11-15 10:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1501 pages (at 38 pages/min), scraped 731 items (at 19 items/min) 2025-11-15 10:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1542 pages (at 41 pages/min), scraped 753 items (at 22 items/min) 2025-11-15 10:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 10:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1579 pages (at 37 pages/min), scraped 773 items (at 20 items/min) 2025-11-15 11:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1621 pages (at 42 pages/min), scraped 792 items (at 19 items/min) 2025-11-15 11:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1659 pages (at 38 pages/min), scraped 810 items (at 18 items/min) 2025-11-15 11:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-65-x-4-65-sheet-labels-pastel-tan-490.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-25-x-0-5-sheet-labels-pastel-tan-829.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-0-5-sheet-labels-pastel-tan-605.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1696 pages (at 37 pages/min), scraped 829 items (at 19 items/min) 2025-11-15 11:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/10-6-x-1-18-sheet-labels-brown-kraft-82.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/6-x-4-sheet-labels-brown-kraft-720.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-0625-x-2-1875-sheet-labels-brown-kraft-755.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-25-x-5-25-sheet-labels-brown-kraft-816.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-25-x-0-5-sheet-labels-pastel-tan-829.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1725 pages (at 29 pages/min), scraped 846 items (at 17 items/min) 2025-11-15 11:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1765 pages (at 40 pages/min), scraped 865 items (at 19 items/min) 2025-11-15 11:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1806 pages (at 41 pages/min), scraped 884 items (at 19 items/min) 2025-11-15 11:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1846 pages (at 40 pages/min), scraped 903 items (at 19 items/min) 2025-11-15 11:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG2015APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG2060APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3010APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4000APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG6090APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9310 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1885 pages (at 39 pages/min), scraped 924 items (at 21 items/min) 2025-11-15 11:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S385WX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S911BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-FLGREEN-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:08:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-FLORANGE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1926 pages (at 41 pages/min), scraped 947 items (at 23 items/min) 2025-11-15 11:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP*Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDF4060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4012-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060A-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 1964 pages (at 38 pages/min), scraped 964 items (at 17 items/min) 2025-11-15 11:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3010AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2003 pages (at 39 pages/min), scraped 982 items (at 18 items/min) 2025-11-15 11:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-fanfold-labels-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3010AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:11:58 [py.warnings] (PID: 57) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-15 11:11:59 [scrapy.extensions.feedexport] (PID: 57) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:1 2025-11-15 11:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2043 pages (at 40 pages/min), scraped 1003 items (at 21 items/min) 2025-11-15 11:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2081 pages (at 38 pages/min), scraped 1023 items (at 20 items/min) 2025-11-15 11:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2122 pages (at 41 pages/min), scraped 1043 items (at 20 items/min) 2025-11-15 11:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2162 pages (at 40 pages/min), scraped 1063 items (at 20 items/min) 2025-11-15 11:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2198 pages (at 36 pages/min), scraped 1080 items (at 17 items/min) 2025-11-15 11:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2240 pages (at 42 pages/min), scraped 1101 items (at 21 items/min) 2025-11-15 11:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2278 pages (at 38 pages/min), scraped 1122 items (at 21 items/min) 2025-11-15 11:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2316 pages (at 38 pages/min), scraped 1141 items (at 19 items/min) 2025-11-15 11:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-pastel-tan-137.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-2-sheet-labels-pastel-tan-610.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/0-42-x-0-58-sheet-labels-pastel-tan-675.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-5-x-2-sheet-labels-brown-kraft-44.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-4375-sheet-labels-brown-kraft-86.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2348 pages (at 32 pages/min), scraped 1157 items (at 16 items/min) 2025-11-15 11:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2390 pages (at 42 pages/min), scraped 1176 items (at 19 items/min) 2025-11-15 11:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2429 pages (at 39 pages/min), scraped 1195 items (at 19 items/min) 2025-11-15 11:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2466 pages (at 37 pages/min), scraped 1216 items (at 21 items/min) 2025-11-15 11:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2504 pages (at 38 pages/min), scraped 1236 items (at 20 items/min) 2025-11-15 11:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=D*0433*1182*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-DKB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTF4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S904AA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT3010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2546 pages (at 42 pages/min), scraped 1255 items (at 19 items/min) 2025-11-15 11:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0014 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4013AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-SENSOR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4020-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT2015AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2585 pages (at 39 pages/min), scraped 1273 items (at 18 items/min) 2025-11-15 11:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4020AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2625 pages (at 40 pages/min), scraped 1292 items (at 19 items/min) 2025-11-15 11:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-ORG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2664 pages (at 39 pages/min), scraped 1314 items (at 22 items/min) 2025-11-15 11:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2706 pages (at 42 pages/min), scraped 1336 items (at 22 items/min) 2025-11-15 11:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2746 pages (at 40 pages/min), scraped 1356 items (at 20 items/min) 2025-11-15 11:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2783 pages (at 37 pages/min), scraped 1372 items (at 16 items/min) 2025-11-15 11:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2825 pages (at 42 pages/min), scraped 1393 items (at 21 items/min) 2025-11-15 11:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2865 pages (at 40 pages/min), scraped 1415 items (at 22 items/min) 2025-11-15 11:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2904 pages (at 39 pages/min), scraped 1436 items (at 21 items/min) 2025-11-15 11:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2947 pages (at 43 pages/min), scraped 1456 items (at 20 items/min) 2025-11-15 11:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 2986 pages (at 39 pages/min), scraped 1474 items (at 18 items/min) 2025-11-15 11:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3024 pages (at 38 pages/min), scraped 1492 items (at 18 items/min) 2025-11-15 11:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3065 pages (at 41 pages/min), scraped 1515 items (at 23 items/min) 2025-11-15 11:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3107 pages (at 42 pages/min), scraped 1538 items (at 23 items/min) 2025-11-15 11:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3148 pages (at 41 pages/min), scraped 1557 items (at 19 items/min) 2025-11-15 11:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3510APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0433*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTPF4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3186 pages (at 38 pages/min), scraped 1573 items (at 16 items/min) 2025-11-15 11:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP-2X already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6040AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0002 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-SENSOR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3224 pages (at 38 pages/min), scraped 1593 items (at 20 items/min) 2025-11-15 11:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT2060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3265 pages (at 41 pages/min), scraped 1615 items (at 22 items/min) 2025-11-15 11:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3304 pages (at 39 pages/min), scraped 1636 items (at 21 items/min) 2025-11-15 11:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3343 pages (at 39 pages/min), scraped 1652 items (at 16 items/min) 2025-11-15 11:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3384 pages (at 41 pages/min), scraped 1671 items (at 19 items/min) 2025-11-15 11:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3422 pages (at 38 pages/min), scraped 1693 items (at 22 items/min) 2025-11-15 11:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3461 pages (at 39 pages/min), scraped 1714 items (at 21 items/min) 2025-11-15 11:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3503 pages (at 42 pages/min), scraped 1736 items (at 22 items/min) 2025-11-15 11:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3543 pages (at 40 pages/min), scraped 1752 items (at 16 items/min) 2025-11-15 11:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3584 pages (at 41 pages/min), scraped 1772 items (at 20 items/min) 2025-11-15 11:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3623 pages (at 39 pages/min), scraped 1794 items (at 22 items/min) 2025-11-15 11:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3664 pages (at 41 pages/min), scraped 1815 items (at 21 items/min) 2025-11-15 11:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3702 pages (at 38 pages/min), scraped 1834 items (at 19 items/min) 2025-11-15 11:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3740 pages (at 38 pages/min), scraped 1851 items (at 17 items/min) 2025-11-15 11:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3778 pages (at 38 pages/min), scraped 1869 items (at 18 items/min) 2025-11-15 11:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG2010APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3535APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4040APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG6080APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-FLORG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FFT4060 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-B already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3818 pages (at 40 pages/min), scraped 1893 items (at 24 items/min) 2025-11-15 11:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9504 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S902AA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S915CC already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S907GG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT1510AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3856 pages (at 38 pages/min), scraped 1912 items (at 19 items/min) 2025-11-15 11:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040A-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT1510AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-2-thermal-transfer-labels-3-core-gray.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-1-core-blockout-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3891 pages (at 35 pages/min), scraped 1926 items (at 14 items/min) 2025-11-15 11:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 11:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3933 pages (at 42 pages/min), scraped 1946 items (at 20 items/min) 2025-11-15 12:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4080AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 3972 pages (at 39 pages/min), scraped 1968 items (at 22 items/min) 2025-11-15 12:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4015 pages (at 43 pages/min), scraped 1990 items (at 22 items/min) 2025-11-15 12:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-75-x-1-75-sheet-labels-white-mid-gloss-510.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/6-78-x-4-75-sheet-labels-white-mid-gloss-815.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-white-mid-gloss-826.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-white-premium-high-gloss-138.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-625-x-0-875-sheet-labels-white-premium-high-gloss-180.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-372-x-2-5-sheet-labels-white-premium-high-gloss-535.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:46 [py.warnings] (PID: 57) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-15 12:02:47 [scrapy.extensions.feedexport] (PID: 57) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:2 2025-11-15 12:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-625-x-0-875-sheet-labels-white-premium-high-gloss-180.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4046 pages (at 31 pages/min), scraped 2006 items (at 16 items/min) 2025-11-15 12:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-372-x-2-5-sheet-labels-white-premium-high-gloss-535.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4085 pages (at 39 pages/min), scraped 2026 items (at 20 items/min) 2025-11-15 12:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4125 pages (at 40 pages/min), scraped 2045 items (at 19 items/min) 2025-11-15 12:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-25-x-0-5-sheet-labels-turquoise-829.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-83-x-1-sheet-labels-white-polyester-130.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-25-x-2-sheet-labels-white-polyester-175.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-625-x-4-625-sheet-labels-white-polyester-875.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-625-x-1-25-sheet-labels-white-vinyl-drum-240.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-5-x-1-5625-sheet-labels-white-vinyl-drum-785.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-1-sheet-labels-pastel-pink-54.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-pastel-pink-71.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-25-x-0-5-sheet-labels-turquoise-829.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4151 pages (at 26 pages/min), scraped 2059 items (at 14 items/min) 2025-11-15 12:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-83-x-1-sheet-labels-white-polyester-130.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/0-5-x-0-75-sheet-labels-pastel-pink-181.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-625-x-4-625-sheet-labels-white-polyester-875.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-625-x-1-25-sheet-labels-white-vinyl-drum-240.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-5-x-1-5625-sheet-labels-white-vinyl-drum-785.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-pastel-pink-71.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-1-sheet-labels-pastel-pink-54.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-33-sheet-labels-pastel-purple-51.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-25-x-11-sheet-labels-pastel-purple-129.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-625-x-1-25-sheet-labels-pastel-purple-240.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/0-5-x-0-75-sheet-labels-pastel-pink-181.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-625-x-1-25-sheet-labels-white-vinyl-drum-240.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4166 pages (at 15 pages/min), scraped 2065 items (at 6 items/min) 2025-11-15 12:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-5-x-1-5625-sheet-labels-white-vinyl-drum-785.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-1-sheet-labels-pastel-pink-54.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-33-sheet-labels-pastel-purple-51.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-25-x-11-sheet-labels-pastel-purple-129.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-57-x-4-57-sheet-labels-pastel-purple-545.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-625-x-1-25-sheet-labels-pastel-purple-240.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-pastel-purple-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-5-sheet-labels-pastel-purple-780.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-625-x-1-25-sheet-labels-white-vinyl-drum-240.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-7656-x-4-7656-sheet-labels-pastel-purple-835.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-57-x-4-57-sheet-labels-pastel-purple-545.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-33-sheet-labels-pastel-purple-51.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/5-5-x-5-5-sheet-labels-pastel-blue-41.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-pastel-purple-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4181 pages (at 15 pages/min), scraped 2071 items (at 6 items/min) 2025-11-15 12:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-375-x-10-875-sheet-labels-pastel-blue-340.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-5-x-0-75-sheet-labels-pastel-blue-220.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-875-x-4-312-sheet-labels-pastel-blue-680.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-57-x-4-57-sheet-labels-pastel-purple-545.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-33-sheet-labels-pastel-purple-51.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/5-5-x-5-5-sheet-labels-pastel-blue-41.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-pastel-purple-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-sheet-labels-pastel-blue-885.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-375-x-10-875-sheet-labels-pastel-blue-340.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-pastel-green-127.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4196 pages (at 15 pages/min), scraped 2081 items (at 10 items/min) 2025-11-15 12:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-0-75-sheet-labels-pastel-green-260.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-57-x-4-57-sheet-labels-pastel-purple-545.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/5-5-x-5-5-sheet-labels-pastel-blue-41.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-6875-x-2-sheet-labels-pastel-green-360.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-pastel-purple-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-875-x-3-875-sheet-labels-pastel-green-395.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-pastel-green-421.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-pastel-green-630.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-sheet-labels-pastel-blue-885.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/6-25-x-0-5-sheet-labels-pastel-green-745.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-375-x-10-875-sheet-labels-pastel-blue-340.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-33-sheet-labels-pastel-purple-51.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-1494-x-3-3072-sheet-labels-pastel-green-828.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-pastel-green-127.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-0-75-sheet-labels-pastel-green-260.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/5-5-x-5-5-sheet-labels-pastel-blue-41.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-875-x-3-875-sheet-labels-pastel-green-395.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-pastel-purple-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-pastel-green-630.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4205 pages (at 9 pages/min), scraped 2086 items (at 5 items/min) 2025-11-15 12:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-sheet-labels-pastel-blue-885.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:15 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 12:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-375-x-10-875-sheet-labels-pastel-blue-340.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:15 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PP>: HTTP status code is not handled or not allowed 2025-11-15 12:10:16 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 12:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:16 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-1-33-sheet-labels-pastel-purple-51.html>: HTTP status code is not handled or not allowed 2025-11-15 12:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-pastel-yellow-77.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-pastel-green-127.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-5-x-0-75-sheet-labels-pastel-yellow-220.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-83-x-2-2-sheet-labels-pastel-yellow-345.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-0-5-sheet-labels-pastel-yellow-605.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-5-sheet-labels-pastel-yellow-780.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:39 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 12:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-875-x-3-875-sheet-labels-pastel-green-395.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:39 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/2-x-2-sheet-labels-pastel-purple-585.html>: HTTP status code is not handled or not allowed 2025-11-15 12:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-pastel-green-630.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-375-x-10-875-sheet-labels-pastel-blue-340.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-625-x-1-sheet-labels-pastel-orange-16.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/0-5-x-0-75-sheet-labels-pastel-orange-181.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-pastel-green-127.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-3-666-sheet-labels-pastel-orange-320.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-83-x-2-2-sheet-labels-pastel-yellow-345.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-0-5-sheet-labels-pastel-yellow-605.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-5-sheet-labels-pastel-yellow-780.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4220 pages (at 15 pages/min), scraped 2091 items (at 5 items/min) 2025-11-15 12:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-875-x-3-875-sheet-labels-pastel-green-395.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:25 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 12:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-pastel-green-630.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:25 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/8-375-x-10-875-sheet-labels-pastel-blue-340.html>: HTTP status code is not handled or not allowed 2025-11-15 12:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-625-x-1-sheet-labels-pastel-orange-16.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/0-5-x-0-75-sheet-labels-pastel-orange-181.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-3-666-sheet-labels-pastel-orange-320.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-0-5-sheet-labels-pastel-yellow-605.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-5-sheet-labels-pastel-yellow-780.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-pastel-green-630.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4233 pages (at 13 pages/min), scraped 2093 items (at 2 items/min) 2025-11-15 12:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-3-666-sheet-labels-pastel-orange-320.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-5-sheet-labels-pastel-yellow-780.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:34 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 12:12:34 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/1-x-1-sheet-labels-pastel-green-630.html>: HTTP status code is not handled or not allowed 2025-11-15 12:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-3-666-sheet-labels-pastel-orange-320.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-125-x-4-875-sheet-labels-brown-kraft-59.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4249 pages (at 16 pages/min), scraped 2102 items (at 9 items/min) 2025-11-15 12:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-brown-kraft-71.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/5-x-3-50785-sheet-labels-brown-kraft-73.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-83-x-1-sheet-labels-brown-kraft-84.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-625-x-0-875-sheet-labels-brown-kraft-180.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-brown-kraft-187.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-75-x-4-75-sheet-labels-brown-kraft-203.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4280 pages (at 31 pages/min), scraped 2118 items (at 16 items/min) 2025-11-15 12:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4323 pages (at 43 pages/min), scraped 2143 items (at 25 items/min) 2025-11-15 12:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4363 pages (at 40 pages/min), scraped 2163 items (at 20 items/min) 2025-11-15 12:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4403 pages (at 40 pages/min), scraped 2180 items (at 17 items/min) 2025-11-15 12:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG1510APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4025APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4070APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4441 pages (at 38 pages/min), scraped 2196 items (at 16 items/min) 2025-11-15 12:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9402 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S927BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4080AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0007 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4040AP-2X already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4479 pages (at 38 pages/min), scraped 2218 items (at 22 items/min) 2025-11-15 12:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4025-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4519 pages (at 40 pages/min), scraped 2241 items (at 23 items/min) 2025-11-15 12:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4558 pages (at 39 pages/min), scraped 2259 items (at 18 items/min) 2025-11-15 12:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4598 pages (at 40 pages/min), scraped 2275 items (at 16 items/min) 2025-11-15 12:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4638 pages (at 40 pages/min), scraped 2296 items (at 21 items/min) 2025-11-15 12:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4677 pages (at 39 pages/min), scraped 2318 items (at 22 items/min) 2025-11-15 12:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4717 pages (at 40 pages/min), scraped 2340 items (at 22 items/min) 2025-11-15 12:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4757 pages (at 40 pages/min), scraped 2358 items (at 18 items/min) 2025-11-15 12:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4796 pages (at 39 pages/min), scraped 2374 items (at 16 items/min) 2025-11-15 12:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4834 pages (at 38 pages/min), scraped 2395 items (at 21 items/min) 2025-11-15 12:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4875 pages (at 41 pages/min), scraped 2419 items (at 24 items/min) 2025-11-15 12:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4914 pages (at 39 pages/min), scraped 2438 items (at 19 items/min) 2025-11-15 12:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4955 pages (at 41 pages/min), scraped 2455 items (at 17 items/min) 2025-11-15 12:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:32:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 4992 pages (at 37 pages/min), scraped 2472 items (at 17 items/min) 2025-11-15 12:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5030 pages (at 38 pages/min), scraped 2495 items (at 23 items/min) 2025-11-15 12:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5071 pages (at 41 pages/min), scraped 2518 items (at 23 items/min) 2025-11-15 12:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FFT4020 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-HOTPINK-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT2312540A-DYMO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:34:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5111 pages (at 40 pages/min), scraped 2536 items (at 18 items/min) 2025-11-15 12:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDF4060AP-Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSC0003 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5150 pages (at 39 pages/min), scraped 2551 items (at 15 items/min) 2025-11-15 12:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4010AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3040AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5189 pages (at 39 pages/min), scraped 2571 items (at 20 items/min) 2025-11-15 12:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4000-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5227 pages (at 38 pages/min), scraped 2594 items (at 23 items/min) 2025-11-15 12:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5267 pages (at 40 pages/min), scraped 2614 items (at 20 items/min) 2025-11-15 12:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6090AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5307 pages (at 40 pages/min), scraped 2631 items (at 17 items/min) 2025-11-15 12:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5348 pages (at 41 pages/min), scraped 2650 items (at 19 items/min) 2025-11-15 12:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5387 pages (at 39 pages/min), scraped 2672 items (at 22 items/min) 2025-11-15 12:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5429 pages (at 42 pages/min), scraped 2695 items (at 23 items/min) 2025-11-15 12:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5466 pages (at 37 pages/min), scraped 2714 items (at 19 items/min) 2025-11-15 12:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5505 pages (at 39 pages/min), scraped 2730 items (at 16 items/min) 2025-11-15 12:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5546 pages (at 41 pages/min), scraped 2750 items (at 20 items/min) 2025-11-15 12:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5583 pages (at 37 pages/min), scraped 2771 items (at 21 items/min) 2025-11-15 12:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5625 pages (at 42 pages/min), scraped 2793 items (at 22 items/min) 2025-11-15 12:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5664 pages (at 39 pages/min), scraped 2811 items (at 18 items/min) 2025-11-15 12:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5704 pages (at 40 pages/min), scraped 2829 items (at 18 items/min) 2025-11-15 12:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3050APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTF4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-0-75-sheet-labels-260.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5741 pages (at 37 pages/min), scraped 2849 items (at 20 items/min) 2025-11-15 12:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-6-x-1-77-sheet-labels-430.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-5-x-2-375-sheet-labels-685.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-75-x-1-25-sheet-labels-843.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S929BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-1-core-nonperforated-polypropylene-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTF4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-0-75-sheet-labels-260.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSB0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/60mm-x-80mm-blank-digi-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-top-coated-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-x-1-25-thermal-transfer-labels-1-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-75-x-1-25-sheet-labels-843.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5759 pages (at 18 pages/min), scraped 2858 items (at 9 items/min) 2025-11-15 12:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-nonperforated-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-8-direct-thermal-labels-3-core-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSB0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-top-coated-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-x-1-25-thermal-transfer-labels-1-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-75-x-1-25-sheet-labels-843.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-fanfold-labels-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-yellow.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-nonperforated-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-5-thermal-transfer-fanfold-labels-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-direct-thermal-labels-0-75-core-gray.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-8-direct-thermal-labels-3-core-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSB0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-freezer.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-top-coated-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5765 pages (at 6 pages/min), scraped 2862 items (at 4 items/min) 2025-11-15 12:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-x-1-25-thermal-transfer-labels-1-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-75-x-1-25-sheet-labels-843.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-fanfold-labels-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-yellow.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-nonperforated-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-5-thermal-transfer-fanfold-labels-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-direct-thermal-labels-0-75-core-gray.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-8-direct-thermal-labels-3-core-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSB0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-freezer.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-top-coated-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-x-1-25-thermal-transfer-labels-1-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-75-x-1-25-sheet-labels-843.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-fanfold-labels-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-3-core-nonperforated-yellow.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-nonperforated-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-5-thermal-transfer-fanfold-labels-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-direct-thermal-labels-0-75-core-gray.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5765 pages (at 0 pages/min), scraped 2862 items (at 0 items/min) 2025-11-15 12:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-8-direct-thermal-labels-3-core-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSB0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-freezer.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:22 [scrapy.downloadermiddlewares.retry] (PID: 57) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-15 12:54:22 [scrapy.spidermiddlewares.httperror] (PID: 57) INFO: Ignoring response <403 https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325SF>: HTTP status code is not handled or not allowed 2025-11-15 12:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-1-core-top-coated-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-25-x-1-25-thermal-transfer-labels-1-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDF4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5795 pages (at 30 pages/min), scraped 2873 items (at 11 items/min) 2025-11-15 12:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4080-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5836 pages (at 41 pages/min), scraped 2896 items (at 23 items/min) 2025-11-15 12:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4015AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5875 pages (at 39 pages/min), scraped 2916 items (at 20 items/min) 2025-11-15 12:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5915 pages (at 40 pages/min), scraped 2936 items (at 20 items/min) 2025-11-15 12:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5953 pages (at 38 pages/min), scraped 2953 items (at 17 items/min) 2025-11-15 12:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 12:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 5993 pages (at 40 pages/min), scraped 2973 items (at 20 items/min) 2025-11-15 13:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6034 pages (at 41 pages/min), scraped 2995 items (at 22 items/min) 2025-11-15 13:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:30 [py.warnings] (PID: 57) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-15 13:01:31 [scrapy.extensions.feedexport] (PID: 57) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:3 2025-11-15 13:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6071 pages (at 37 pages/min), scraped 3015 items (at 20 items/min) 2025-11-15 13:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6113 pages (at 42 pages/min), scraped 3036 items (at 21 items/min) 2025-11-15 13:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6152 pages (at 39 pages/min), scraped 3053 items (at 17 items/min) 2025-11-15 13:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6191 pages (at 39 pages/min), scraped 3072 items (at 19 items/min) 2025-11-15 13:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6229 pages (at 38 pages/min), scraped 3093 items (at 21 items/min) 2025-11-15 13:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6269 pages (at 40 pages/min), scraped 3114 items (at 21 items/min) 2025-11-15 13:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6308 pages (at 39 pages/min), scraped 3133 items (at 19 items/min) 2025-11-15 13:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6348 pages (at 40 pages/min), scraped 3151 items (at 18 items/min) 2025-11-15 13:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6389 pages (at 41 pages/min), scraped 3171 items (at 20 items/min) 2025-11-15 13:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG6060APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-BR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-2X already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6430 pages (at 41 pages/min), scraped 3193 items (at 22 items/min) 2025-11-15 13:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9330 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9304 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S906GG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S910GG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S916CC already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6468 pages (at 38 pages/min), scraped 3213 items (at 20 items/min) 2025-11-15 13:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSB0003 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT225125AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-SENSOR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6506 pages (at 38 pages/min), scraped 3231 items (at 18 items/min) 2025-11-15 13:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3050A-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3100A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6546 pages (at 40 pages/min), scraped 3249 items (at 18 items/min) 2025-11-15 13:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6584 pages (at 38 pages/min), scraped 3269 items (at 20 items/min) 2025-11-15 13:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6623 pages (at 39 pages/min), scraped 3291 items (at 22 items/min) 2025-11-15 13:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6663 pages (at 40 pages/min), scraped 3311 items (at 20 items/min) 2025-11-15 13:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6704 pages (at 41 pages/min), scraped 3330 items (at 19 items/min) 2025-11-15 13:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6742 pages (at 38 pages/min), scraped 3348 items (at 18 items/min) 2025-11-15 13:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6781 pages (at 39 pages/min), scraped 3368 items (at 20 items/min) 2025-11-15 13:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6820 pages (at 39 pages/min), scraped 3389 items (at 21 items/min) 2025-11-15 13:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6860 pages (at 40 pages/min), scraped 3409 items (at 20 items/min) 2025-11-15 13:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6901 pages (at 41 pages/min), scraped 3428 items (at 19 items/min) 2025-11-15 13:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6942 pages (at 41 pages/min), scraped 3448 items (at 20 items/min) 2025-11-15 13:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 6978 pages (at 36 pages/min), scraped 3468 items (at 20 items/min) 2025-11-15 13:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7017 pages (at 39 pages/min), scraped 3488 items (at 20 items/min) 2025-11-15 13:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7059 pages (at 42 pages/min), scraped 3508 items (at 20 items/min) 2025-11-15 13:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3030APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=D*0433*1182*X*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTF4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9306 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7098 pages (at 39 pages/min), scraped 3525 items (at 17 items/min) 2025-11-15 13:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S912BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4060-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S903BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4030 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7135 pages (at 37 pages/min), scraped 3544 items (at 19 items/min) 2025-11-15 13:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDF3050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020A-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FFD4060-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4013-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7174 pages (at 39 pages/min), scraped 3566 items (at 22 items/min) 2025-11-15 13:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3050AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7212 pages (at 38 pages/min), scraped 3585 items (at 19 items/min) 2025-11-15 13:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7254 pages (at 42 pages/min), scraped 3605 items (at 20 items/min) 2025-11-15 13:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7293 pages (at 39 pages/min), scraped 3623 items (at 18 items/min) 2025-11-15 13:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7333 pages (at 40 pages/min), scraped 3644 items (at 21 items/min) 2025-11-15 13:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7373 pages (at 40 pages/min), scraped 3666 items (at 22 items/min) 2025-11-15 13:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7411 pages (at 38 pages/min), scraped 3685 items (at 19 items/min) 2025-11-15 13:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7449 pages (at 38 pages/min), scraped 3701 items (at 16 items/min) 2025-11-15 13:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7489 pages (at 40 pages/min), scraped 3721 items (at 20 items/min) 2025-11-15 13:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7528 pages (at 39 pages/min), scraped 3743 items (at 22 items/min) 2025-11-15 13:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7568 pages (at 40 pages/min), scraped 3763 items (at 20 items/min) 2025-11-15 13:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7608 pages (at 40 pages/min), scraped 3783 items (at 20 items/min) 2025-11-15 13:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7646 pages (at 38 pages/min), scraped 3799 items (at 16 items/min) 2025-11-15 13:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7682 pages (at 36 pages/min), scraped 3818 items (at 19 items/min) 2025-11-15 13:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7725 pages (at 43 pages/min), scraped 3842 items (at 24 items/min) 2025-11-15 13:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3040APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3580APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG40120APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-ORG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTPF4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7762 pages (at 37 pages/min), scraped 3859 items (at 17 items/min) 2025-11-15 13:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S370WX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-CHARTREUSE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETP4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSC0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7802 pages (at 40 pages/min), scraped 3878 items (at 19 items/min) 2025-11-15 13:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4030-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP3010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3020AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7840 pages (at 38 pages/min), scraped 3897 items (at 19 items/min) 2025-11-15 13:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030A-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7877 pages (at 37 pages/min), scraped 3917 items (at 20 items/min) 2025-11-15 13:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4013AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7918 pages (at 41 pages/min), scraped 3938 items (at 21 items/min) 2025-11-15 13:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7957 pages (at 39 pages/min), scraped 3956 items (at 18 items/min) 2025-11-15 13:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 7995 pages (at 38 pages/min), scraped 3974 items (at 18 items/min) 2025-11-15 13:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8035 pages (at 40 pages/min), scraped 3994 items (at 20 items/min) 2025-11-15 13:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:28 [py.warnings] (PID: 57) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-15 13:52:29 [scrapy.extensions.feedexport] (PID: 57) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:4 2025-11-15 13:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8074 pages (at 39 pages/min), scraped 4016 items (at 22 items/min) 2025-11-15 13:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8113 pages (at 39 pages/min), scraped 4035 items (at 19 items/min) 2025-11-15 13:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8154 pages (at 41 pages/min), scraped 4054 items (at 19 items/min) 2025-11-15 13:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8194 pages (at 40 pages/min), scraped 4074 items (at 20 items/min) 2025-11-15 13:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-5-x-2-5-sheet-labels-pastel-green-140.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-1-sheet-labels-pastel-green-198.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8229 pages (at 35 pages/min), scraped 4093 items (at 19 items/min) 2025-11-15 13:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8269 pages (at 40 pages/min), scraped 4114 items (at 21 items/min) 2025-11-15 13:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8310 pages (at 41 pages/min), scraped 4133 items (at 19 items/min) 2025-11-15 13:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 13:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8350 pages (at 40 pages/min), scraped 4151 items (at 18 items/min) 2025-11-15 14:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8386 pages (at 36 pages/min), scraped 4170 items (at 19 items/min) 2025-11-15 14:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8426 pages (at 40 pages/min), scraped 4193 items (at 23 items/min) 2025-11-15 14:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4080APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTAG4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4065AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8466 pages (at 40 pages/min), scraped 4213 items (at 20 items/min) 2025-11-15 14:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-PURPLE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-BROWN-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8506 pages (at 40 pages/min), scraped 4230 items (at 17 items/min) 2025-11-15 14:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP-G already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8546 pages (at 40 pages/min), scraped 4250 items (at 20 items/min) 2025-11-15 14:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8585 pages (at 39 pages/min), scraped 4270 items (at 20 items/min) 2025-11-15 14:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8624 pages (at 39 pages/min), scraped 4290 items (at 20 items/min) 2025-11-15 14:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8664 pages (at 40 pages/min), scraped 4311 items (at 21 items/min) 2025-11-15 14:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8703 pages (at 39 pages/min), scraped 4328 items (at 17 items/min) 2025-11-15 14:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8744 pages (at 41 pages/min), scraped 4348 items (at 20 items/min) 2025-11-15 14:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8781 pages (at 37 pages/min), scraped 4369 items (at 21 items/min) 2025-11-15 14:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8820 pages (at 39 pages/min), scraped 4390 items (at 21 items/min) 2025-11-15 14:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8861 pages (at 41 pages/min), scraped 4408 items (at 18 items/min) 2025-11-15 14:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8900 pages (at 39 pages/min), scraped 4427 items (at 19 items/min) 2025-11-15 14:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8941 pages (at 41 pages/min), scraped 4447 items (at 20 items/min) 2025-11-15 14:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 8980 pages (at 39 pages/min), scraped 4470 items (at 23 items/min) 2025-11-15 14:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9008 pages (at 28 pages/min), scraped 4479 items (at 9 items/min) 2025-11-15 14:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9047 pages (at 39 pages/min), scraped 4500 items (at 21 items/min) 2025-11-15 14:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3020APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG40100APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=D*0400*1182*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0327*1476*X*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9085 pages (at 38 pages/min), scraped 4523 items (at 23 items/min) 2025-11-15 14:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-LTGN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-CHA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4020 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9123 pages (at 38 pages/min), scraped 4540 items (at 17 items/min) 2025-11-15 14:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4040-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3050A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9160 pages (at 37 pages/min), scraped 4556 items (at 16 items/min) 2025-11-15 14:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9201 pages (at 41 pages/min), scraped 4577 items (at 21 items/min) 2025-11-15 14:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9240 pages (at 39 pages/min), scraped 4599 items (at 22 items/min) 2025-11-15 14:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9281 pages (at 41 pages/min), scraped 4621 items (at 22 items/min) 2025-11-15 14:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9322 pages (at 41 pages/min), scraped 4640 items (at 19 items/min) 2025-11-15 14:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9360 pages (at 38 pages/min), scraped 4656 items (at 16 items/min) 2025-11-15 14:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9398 pages (at 38 pages/min), scraped 4676 items (at 20 items/min) 2025-11-15 14:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9441 pages (at 43 pages/min), scraped 4701 items (at 25 items/min) 2025-11-15 14:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9481 pages (at 40 pages/min), scraped 4721 items (at 20 items/min) 2025-11-15 14:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9521 pages (at 40 pages/min), scraped 4737 items (at 16 items/min) 2025-11-15 14:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9560 pages (at 39 pages/min), scraped 4755 items (at 18 items/min) 2025-11-15 14:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9599 pages (at 39 pages/min), scraped 4777 items (at 22 items/min) 2025-11-15 14:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9642 pages (at 43 pages/min), scraped 4801 items (at 24 items/min) 2025-11-15 14:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9682 pages (at 40 pages/min), scraped 4820 items (at 19 items/min) 2025-11-15 14:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9721 pages (at 39 pages/min), scraped 4837 items (at 17 items/min) 2025-11-15 14:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-KIT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9401 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S636WX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S926AA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9759 pages (at 38 pages/min), scraped 4856 items (at 19 items/min) 2025-11-15 14:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S919DD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT40625AP-DYMO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0006 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0006 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AP-Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0013 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9797 pages (at 38 pages/min), scraped 4877 items (at 21 items/min) 2025-11-15 14:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9839 pages (at 42 pages/min), scraped 4899 items (at 22 items/min) 2025-11-15 14:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9875 pages (at 36 pages/min), scraped 4916 items (at 17 items/min) 2025-11-15 14:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4065AP-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9917 pages (at 42 pages/min), scraped 4935 items (at 19 items/min) 2025-11-15 14:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4100AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9956 pages (at 39 pages/min), scraped 4955 items (at 20 items/min) 2025-11-15 14:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 9993 pages (at 37 pages/min), scraped 4976 items (at 21 items/min) 2025-11-15 14:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10033 pages (at 40 pages/min), scraped 4995 items (at 19 items/min) 2025-11-15 14:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:21 [py.warnings] (PID: 57) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-15 14:43:22 [scrapy.extensions.feedexport] (PID: 57) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:5 2025-11-15 14:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10075 pages (at 42 pages/min), scraped 5016 items (at 21 items/min) 2025-11-15 14:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:44:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10115 pages (at 40 pages/min), scraped 5034 items (at 18 items/min) 2025-11-15 14:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10154 pages (at 39 pages/min), scraped 5054 items (at 20 items/min) 2025-11-15 14:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-4375-x-0-667-sheet-labels-pastel-green-126.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-5-sheet-labels-pastel-green-215.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-25-x-10-75-sheet-labels-pastel-green-485.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10187 pages (at 33 pages/min), scraped 5072 items (at 18 items/min) 2025-11-15 14:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-625-x-1-sheet-labels-pastel-yellow-16.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/6-x-4-sheet-labels-pastel-yellow-110.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-3-25-sheet-labels-pastel-yellow-165.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-0-75-sheet-labels-pastel-yellow-260.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-5625-x-1-75-sheet-labels-pastel-yellow-440.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-5-x-2-75-sheet-labels-pastel-yellow-465.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/6-x-4-sheet-labels-pastel-yellow-110.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-3-25-sheet-labels-pastel-yellow-165.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10212 pages (at 25 pages/min), scraped 5087 items (at 15 items/min) 2025-11-15 14:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10253 pages (at 41 pages/min), scraped 5103 items (at 16 items/min) 2025-11-15 14:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:49:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10295 pages (at 42 pages/min), scraped 5124 items (at 21 items/min) 2025-11-15 14:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10334 pages (at 39 pages/min), scraped 5143 items (at 19 items/min) 2025-11-15 14:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10374 pages (at 40 pages/min), scraped 5167 items (at 24 items/min) 2025-11-15 14:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG225125APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-FLGRN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10413 pages (at 39 pages/min), scraped 5186 items (at 19 items/min) 2025-11-15 14:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9503 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S908BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-YELLOW-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4040 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4060 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4080 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT2010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FFD4060 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10454 pages (at 41 pages/min), scraped 5204 items (at 18 items/min) 2025-11-15 14:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0006 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETP4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10494 pages (at 40 pages/min), scraped 5223 items (at 19 items/min) 2025-11-15 14:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4030AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10532 pages (at 38 pages/min), scraped 5243 items (at 20 items/min) 2025-11-15 14:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10572 pages (at 40 pages/min), scraped 5266 items (at 23 items/min) 2025-11-15 14:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10615 pages (at 43 pages/min), scraped 5288 items (at 22 items/min) 2025-11-15 14:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10654 pages (at 39 pages/min), scraped 5304 items (at 16 items/min) 2025-11-15 14:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 14:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10693 pages (at 39 pages/min), scraped 5323 items (at 19 items/min) 2025-11-15 15:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10734 pages (at 41 pages/min), scraped 5344 items (at 21 items/min) 2025-11-15 15:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10776 pages (at 42 pages/min), scraped 5367 items (at 23 items/min) 2025-11-15 15:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-656-x-4-656-sheet-labels-pastel-blue-97.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10810 pages (at 34 pages/min), scraped 5383 items (at 16 items/min) 2025-11-15 15:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10850 pages (at 40 pages/min), scraped 5403 items (at 20 items/min) 2025-11-15 15:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10890 pages (at 40 pages/min), scraped 5422 items (at 19 items/min) 2025-11-15 15:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10932 pages (at 42 pages/min), scraped 5445 items (at 23 items/min) 2025-11-15 15:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 10972 pages (at 40 pages/min), scraped 5464 items (at 19 items/min) 2025-11-15 15:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11013 pages (at 41 pages/min), scraped 5485 items (at 21 items/min) 2025-11-15 15:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4060APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG6040APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11052 pages (at 39 pages/min), scraped 5504 items (at 19 items/min) 2025-11-15 15:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-GREEN-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4090AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0003 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11091 pages (at 39 pages/min), scraped 5522 items (at 18 items/min) 2025-11-15 15:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11131 pages (at 40 pages/min), scraped 5544 items (at 22 items/min) 2025-11-15 15:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT5030-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11170 pages (at 39 pages/min), scraped 5563 items (at 19 items/min) 2025-11-15 15:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11209 pages (at 39 pages/min), scraped 5582 items (at 19 items/min) 2025-11-15 15:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11249 pages (at 40 pages/min), scraped 5602 items (at 20 items/min) 2025-11-15 15:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11287 pages (at 38 pages/min), scraped 5621 items (at 19 items/min) 2025-11-15 15:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11328 pages (at 41 pages/min), scraped 5642 items (at 21 items/min) 2025-11-15 15:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11366 pages (at 38 pages/min), scraped 5662 items (at 20 items/min) 2025-11-15 15:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11405 pages (at 39 pages/min), scraped 5681 items (at 19 items/min) 2025-11-15 15:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11443 pages (at 38 pages/min), scraped 5698 items (at 17 items/min) 2025-11-15 15:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11482 pages (at 39 pages/min), scraped 5719 items (at 21 items/min) 2025-11-15 15:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11522 pages (at 40 pages/min), scraped 5740 items (at 21 items/min) 2025-11-15 15:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11562 pages (at 40 pages/min), scraped 5759 items (at 19 items/min) 2025-11-15 15:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11604 pages (at 42 pages/min), scraped 5780 items (at 21 items/min) 2025-11-15 15:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11642 pages (at 38 pages/min), scraped 5798 items (at 18 items/min) 2025-11-15 15:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-B already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-PUR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FFT4060-Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11683 pages (at 41 pages/min), scraped 5819 items (at 21 items/min) 2025-11-15 15:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S913BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11723 pages (at 40 pages/min), scraped 5840 items (at 21 items/min) 2025-11-15 15:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDPF4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11762 pages (at 39 pages/min), scraped 5859 items (at 19 items/min) 2025-11-15 15:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080A-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11802 pages (at 40 pages/min), scraped 5878 items (at 19 items/min) 2025-11-15 15:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4013A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11841 pages (at 39 pages/min), scraped 5898 items (at 20 items/min) 2025-11-15 15:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11880 pages (at 39 pages/min), scraped 5917 items (at 19 items/min) 2025-11-15 15:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11920 pages (at 40 pages/min), scraped 5938 items (at 21 items/min) 2025-11-15 15:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11958 pages (at 38 pages/min), scraped 5958 items (at 20 items/min) 2025-11-15 15:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 11995 pages (at 37 pages/min), scraped 5975 items (at 17 items/min) 2025-11-15 15:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12035 pages (at 40 pages/min), scraped 5995 items (at 20 items/min) 2025-11-15 15:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:21 [py.warnings] (PID: 57) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-15 15:34:22 [scrapy.extensions.feedexport] (PID: 57) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:6 2025-11-15 15:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12075 pages (at 40 pages/min), scraped 6016 items (at 21 items/min) 2025-11-15 15:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12114 pages (at 39 pages/min), scraped 6035 items (at 19 items/min) 2025-11-15 15:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12152 pages (at 38 pages/min), scraped 6054 items (at 19 items/min) 2025-11-15 15:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12190 pages (at 38 pages/min), scraped 6073 items (at 19 items/min) 2025-11-15 15:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12231 pages (at 41 pages/min), scraped 6093 items (at 20 items/min) 2025-11-15 15:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12272 pages (at 41 pages/min), scraped 6114 items (at 21 items/min) 2025-11-15 15:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=E*0433*244*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12314 pages (at 42 pages/min), scraped 6135 items (at 21 items/min) 2025-11-15 15:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=I*0410*500*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S901AA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S905GG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S914EE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S918DD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12351 pages (at 37 pages/min), scraped 6152 items (at 17 items/min) 2025-11-15 15:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S920BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSB0002 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP-B already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4060-Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12390 pages (at 39 pages/min), scraped 6172 items (at 20 items/min) 2025-11-15 15:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4040AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-5-x-8-thermal-transfer-labels-3-core-blue.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12425 pages (at 35 pages/min), scraped 6191 items (at 19 items/min) 2025-11-15 15:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:44:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12468 pages (at 43 pages/min), scraped 6213 items (at 22 items/min) 2025-11-15 15:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12507 pages (at 39 pages/min), scraped 6231 items (at 18 items/min) 2025-11-15 15:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12547 pages (at 40 pages/min), scraped 6251 items (at 20 items/min) 2025-11-15 15:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12585 pages (at 38 pages/min), scraped 6271 items (at 20 items/min) 2025-11-15 15:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12623 pages (at 38 pages/min), scraped 6290 items (at 19 items/min) 2025-11-15 15:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12665 pages (at 42 pages/min), scraped 6310 items (at 20 items/min) 2025-11-15 15:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12704 pages (at 39 pages/min), scraped 6330 items (at 20 items/min) 2025-11-15 15:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12744 pages (at 40 pages/min), scraped 6350 items (at 20 items/min) 2025-11-15 15:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12782 pages (at 38 pages/min), scraped 6370 items (at 20 items/min) 2025-11-15 15:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12823 pages (at 41 pages/min), scraped 6389 items (at 19 items/min) 2025-11-15 15:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12861 pages (at 38 pages/min), scraped 6408 items (at 19 items/min) 2025-11-15 15:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12900 pages (at 39 pages/min), scraped 6428 items (at 20 items/min) 2025-11-15 15:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12938 pages (at 38 pages/min), scraped 6447 items (at 19 items/min) 2025-11-15 15:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4015APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4050APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 12979 pages (at 41 pages/min), scraped 6468 items (at 21 items/min) 2025-11-15 15:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S406WX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-BLUE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4065AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AP-ORG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13018 pages (at 39 pages/min), scraped 6487 items (at 19 items/min) 2025-11-15 15:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDPF4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 15:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13058 pages (at 40 pages/min), scraped 6505 items (at 18 items/min) 2025-11-15 16:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13096 pages (at 38 pages/min), scraped 6526 items (at 21 items/min) 2025-11-15 16:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4025AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13136 pages (at 40 pages/min), scraped 6546 items (at 20 items/min) 2025-11-15 16:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13176 pages (at 40 pages/min), scraped 6566 items (at 20 items/min) 2025-11-15 16:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13216 pages (at 40 pages/min), scraped 6586 items (at 20 items/min) 2025-11-15 16:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13255 pages (at 39 pages/min), scraped 6605 items (at 19 items/min) 2025-11-15 16:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13297 pages (at 42 pages/min), scraped 6627 items (at 22 items/min) 2025-11-15 16:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/6-25-x-0-5-sheet-labels-pastel-purple-745.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/7-x-4-5-sheet-labels-pastel-blue-28.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-5-x-2-sheet-labels-pastel-blue-44.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/5-x-3-50785-sheet-labels-pastel-blue-73.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13333 pages (at 36 pages/min), scraped 6646 items (at 19 items/min) 2025-11-15 16:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-5-x-2-sheet-labels-pastel-blue-202.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13371 pages (at 38 pages/min), scraped 6662 items (at 16 items/min) 2025-11-15 16:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13409 pages (at 38 pages/min), scraped 6681 items (at 19 items/min) 2025-11-15 16:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13450 pages (at 41 pages/min), scraped 6703 items (at 22 items/min) 2025-11-15 16:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13490 pages (at 40 pages/min), scraped 6725 items (at 22 items/min) 2025-11-15 16:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13528 pages (at 38 pages/min), scraped 6742 items (at 17 items/min) 2025-11-15 16:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG40130APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0866*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTPF4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13569 pages (at 41 pages/min), scraped 6761 items (at 19 items/min) 2025-11-15 16:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-RED-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT225125AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT3020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4000 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13608 pages (at 39 pages/min), scraped 6781 items (at 20 items/min) 2025-11-15 16:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3050AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AP-G already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6040A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13646 pages (at 38 pages/min), scraped 6801 items (at 20 items/min) 2025-11-15 16:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13685 pages (at 39 pages/min), scraped 6821 items (at 20 items/min) 2025-11-15 16:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13723 pages (at 38 pages/min), scraped 6838 items (at 17 items/min) 2025-11-15 16:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13761 pages (at 38 pages/min), scraped 6857 items (at 19 items/min) 2025-11-15 16:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13800 pages (at 39 pages/min), scraped 6878 items (at 21 items/min) 2025-11-15 16:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13839 pages (at 39 pages/min), scraped 6899 items (at 21 items/min) 2025-11-15 16:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13880 pages (at 41 pages/min), scraped 6918 items (at 19 items/min) 2025-11-15 16:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13920 pages (at 40 pages/min), scraped 6937 items (at 19 items/min) 2025-11-15 16:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13959 pages (at 39 pages/min), scraped 6956 items (at 19 items/min) 2025-11-15 16:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 13998 pages (at 39 pages/min), scraped 6978 items (at 22 items/min) 2025-11-15 16:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14038 pages (at 40 pages/min), scraped 6999 items (at 21 items/min) 2025-11-15 16:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:16 [py.warnings] (PID: 57) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-15 16:25:17 [scrapy.extensions.feedexport] (PID: 57) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:7 2025-11-15 16:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14076 pages (at 38 pages/min), scraped 7016 items (at 17 items/min) 2025-11-15 16:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14114 pages (at 38 pages/min), scraped 7033 items (at 17 items/min) 2025-11-15 16:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4010APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0238*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0327*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-11-laser-sheet-label.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14151 pages (at 37 pages/min), scraped 7053 items (at 20 items/min) 2025-11-15 16:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S380WX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0002 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0010 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14190 pages (at 39 pages/min), scraped 7074 items (at 21 items/min) 2025-11-15 16:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT2010AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14231 pages (at 41 pages/min), scraped 7094 items (at 20 items/min) 2025-11-15 16:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4070-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14270 pages (at 39 pages/min), scraped 7112 items (at 18 items/min) 2025-11-15 16:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14310 pages (at 40 pages/min), scraped 7131 items (at 19 items/min) 2025-11-15 16:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14353 pages (at 43 pages/min), scraped 7153 items (at 22 items/min) 2025-11-15 16:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14391 pages (at 38 pages/min), scraped 7174 items (at 21 items/min) 2025-11-15 16:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14432 pages (at 41 pages/min), scraped 7195 items (at 21 items/min) 2025-11-15 16:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14472 pages (at 40 pages/min), scraped 7214 items (at 19 items/min) 2025-11-15 16:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14513 pages (at 41 pages/min), scraped 7232 items (at 18 items/min) 2025-11-15 16:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14553 pages (at 40 pages/min), scraped 7253 items (at 21 items/min) 2025-11-15 16:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14593 pages (at 40 pages/min), scraped 7275 items (at 22 items/min) 2025-11-15 16:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14632 pages (at 39 pages/min), scraped 7294 items (at 19 items/min) 2025-11-15 16:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14673 pages (at 41 pages/min), scraped 7314 items (at 20 items/min) 2025-11-15 16:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14710 pages (at 37 pages/min), scraped 7330 items (at 16 items/min) 2025-11-15 16:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14751 pages (at 41 pages/min), scraped 7352 items (at 22 items/min) 2025-11-15 16:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4065APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG5030APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP*2 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=800*190*200*110*H already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=800*160*300*110*H already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=800*190*300*110*H already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14789 pages (at 38 pages/min), scraped 7374 items (at 22 items/min) 2025-11-15 16:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S921CC already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4025AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3050AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0008 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSC0005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14827 pages (at 38 pages/min), scraped 7391 items (at 17 items/min) 2025-11-15 16:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-5-thermal-transfer-fanfold-labels-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3050AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0008 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3020A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-thermal-transfer-labels-1-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSC0005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-fanfold-labels-gray.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14857 pages (at 30 pages/min), scraped 7406 items (at 15 items/min) 2025-11-15 16:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT6040-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3535AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14898 pages (at 41 pages/min), scraped 7424 items (at 18 items/min) 2025-11-15 16:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14938 pages (at 40 pages/min), scraped 7445 items (at 21 items/min) 2025-11-15 16:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4090AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6040AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 14978 pages (at 40 pages/min), scraped 7467 items (at 22 items/min) 2025-11-15 16:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15018 pages (at 40 pages/min), scraped 7489 items (at 22 items/min) 2025-11-15 16:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15059 pages (at 41 pages/min), scraped 7508 items (at 19 items/min) 2025-11-15 16:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15099 pages (at 40 pages/min), scraped 7525 items (at 17 items/min) 2025-11-15 16:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15139 pages (at 40 pages/min), scraped 7545 items (at 20 items/min) 2025-11-15 16:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15179 pages (at 40 pages/min), scraped 7568 items (at 23 items/min) 2025-11-15 16:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15220 pages (at 41 pages/min), scraped 7590 items (at 22 items/min) 2025-11-15 16:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15259 pages (at 39 pages/min), scraped 7608 items (at 18 items/min) 2025-11-15 16:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15299 pages (at 40 pages/min), scraped 7623 items (at 15 items/min) 2025-11-15 16:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-5-x-5-sheet-labels-fluorescent-green-255.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-25-x-3-66-sheet-labels-fluorescent-green-290.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-3-33-sheet-labels-fluorescent-yellow-96.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/5-x-5-sheet-labels-fluorescent-yellow-206.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15331 pages (at 32 pages/min), scraped 7643 items (at 20 items/min) 2025-11-15 16:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-25-x-3-sheet-labels-fluorescent-yellow-460.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15367 pages (at 36 pages/min), scraped 7662 items (at 19 items/min) 2025-11-15 16:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 16:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15404 pages (at 37 pages/min), scraped 7680 items (at 18 items/min) 2025-11-15 17:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4090APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=D*0600*1345*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-TOP-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-GRAY-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15444 pages (at 40 pages/min), scraped 7699 items (at 19 items/min) 2025-11-15 17:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0002 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-ORANGE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4020AP-2X already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4100AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0007 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15483 pages (at 39 pages/min), scraped 7718 items (at 19 items/min) 2025-11-15 17:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4065-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15523 pages (at 40 pages/min), scraped 7739 items (at 21 items/min) 2025-11-15 17:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4050AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4100A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15562 pages (at 39 pages/min), scraped 7759 items (at 20 items/min) 2025-11-15 17:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15603 pages (at 41 pages/min), scraped 7778 items (at 19 items/min) 2025-11-15 17:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15641 pages (at 38 pages/min), scraped 7797 items (at 19 items/min) 2025-11-15 17:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15680 pages (at 39 pages/min), scraped 7817 items (at 20 items/min) 2025-11-15 17:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15721 pages (at 41 pages/min), scraped 7838 items (at 21 items/min) 2025-11-15 17:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15759 pages (at 38 pages/min), scraped 7857 items (at 19 items/min) 2025-11-15 17:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15798 pages (at 39 pages/min), scraped 7876 items (at 19 items/min) 2025-11-15 17:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15836 pages (at 38 pages/min), scraped 7894 items (at 18 items/min) 2025-11-15 17:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15877 pages (at 41 pages/min), scraped 7918 items (at 24 items/min) 2025-11-15 17:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15917 pages (at 40 pages/min), scraped 7936 items (at 18 items/min) 2025-11-15 17:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15955 pages (at 38 pages/min), scraped 7954 items (at 18 items/min) 2025-11-15 17:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 15992 pages (at 37 pages/min), scraped 7973 items (at 19 items/min) 2025-11-15 17:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16032 pages (at 40 pages/min), scraped 7994 items (at 21 items/min) 2025-11-15 17:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:30 [py.warnings] (PID: 57) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-15 17:16:31 [scrapy.extensions.feedexport] (PID: 57) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:8 2025-11-15 17:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP*2 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S909BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16075 pages (at 43 pages/min), scraped 8016 items (at 22 items/min) 2025-11-15 17:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-GRAPE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4065AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSI0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3020AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDF4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4050AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0009 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16111 pages (at 36 pages/min), scraped 8034 items (at 18 items/min) 2025-11-15 17:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4012AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4020AP-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16150 pages (at 39 pages/min), scraped 8050 items (at 16 items/min) 2025-11-15 17:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4040AP-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-labels-3-core-nonperforated-orange-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-5-x-1-thermal-transfer-labels-3-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-labels-3-core-nonperforated-fluorescent-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-labels-1-core-fluorescent-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-labels-3-core-nonperforated-orange-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-labels-3-core-yellow.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16172 pages (at 22 pages/min), scraped 8064 items (at 14 items/min) 2025-11-15 17:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-blockout-127.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-5-thermal-transfer-labels-3-core-chartreuse.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-labels-3-core-nonperforated-fluorescent-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16203 pages (at 31 pages/min), scraped 8078 items (at 14 items/min) 2025-11-15 17:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16242 pages (at 39 pages/min), scraped 8097 items (at 19 items/min) 2025-11-15 17:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16282 pages (at 40 pages/min), scraped 8119 items (at 22 items/min) 2025-11-15 17:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16323 pages (at 41 pages/min), scraped 8141 items (at 22 items/min) 2025-11-15 17:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16364 pages (at 41 pages/min), scraped 8161 items (at 20 items/min) 2025-11-15 17:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16403 pages (at 39 pages/min), scraped 8177 items (at 16 items/min) 2025-11-15 17:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16441 pages (at 38 pages/min), scraped 8196 items (at 19 items/min) 2025-11-15 17:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16479 pages (at 38 pages/min), scraped 8218 items (at 22 items/min) 2025-11-15 17:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16520 pages (at 41 pages/min), scraped 8239 items (at 21 items/min) 2025-11-15 17:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-2-sheet-labels-fluorescent-red-885.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-4375-x-0-667-sheet-labels-fluorescent-pink-126.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-9375-x-0-5-sheet-labels-fluorescent-pink-217.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16556 pages (at 36 pages/min), scraped 8256 items (at 17 items/min) 2025-11-15 17:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16593 pages (at 37 pages/min), scraped 8273 items (at 17 items/min) 2025-11-15 17:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16631 pages (at 38 pages/min), scraped 8292 items (at 19 items/min) 2025-11-15 17:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16671 pages (at 40 pages/min), scraped 8314 items (at 22 items/min) 2025-11-15 17:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-625-x-1-sheet-labels-silver-foil-874.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-2-75-sheet-labels-silver-foil-890.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4020APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3060APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG30100APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=D*0433*1345*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0433*985*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0600*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0650*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0433*1476*X*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTPF4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16709 pages (at 38 pages/min), scraped 8333 items (at 19 items/min) 2025-11-15 17:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTAG4065AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=800*190*200*1000*H already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S917DD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0003 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0009 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16748 pages (at 39 pages/min), scraped 8351 items (at 18 items/min) 2025-11-15 17:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT2010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-SENSOR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16786 pages (at 38 pages/min), scraped 8370 items (at 19 items/min) 2025-11-15 17:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16824 pages (at 38 pages/min), scraped 8390 items (at 20 items/min) 2025-11-15 17:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3580AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16861 pages (at 37 pages/min), scraped 8409 items (at 19 items/min) 2025-11-15 17:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16902 pages (at 41 pages/min), scraped 8428 items (at 19 items/min) 2025-11-15 17:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6080AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16941 pages (at 39 pages/min), scraped 8447 items (at 19 items/min) 2025-11-15 17:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 16981 pages (at 40 pages/min), scraped 8467 items (at 20 items/min) 2025-11-15 17:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17018 pages (at 37 pages/min), scraped 8488 items (at 21 items/min) 2025-11-15 17:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17057 pages (at 39 pages/min), scraped 8506 items (at 18 items/min) 2025-11-15 17:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17095 pages (at 38 pages/min), scraped 8524 items (at 18 items/min) 2025-11-15 17:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17133 pages (at 38 pages/min), scraped 8543 items (at 19 items/min) 2025-11-15 17:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17171 pages (at 38 pages/min), scraped 8563 items (at 20 items/min) 2025-11-15 17:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17210 pages (at 39 pages/min), scraped 8584 items (at 21 items/min) 2025-11-15 17:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17249 pages (at 39 pages/min), scraped 8602 items (at 18 items/min) 2025-11-15 17:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-9-sheet-labels-fluorescent-pink-615.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-75-x-2-5-sheet-labels-fluorescent-pink-867.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-5-x-4-5-sheet-labels-fluorescent-green-20.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-1-sheet-labels-fluorescent-green-54.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-fluorescent-green-136.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-5-x-1-5-sheet-labels-fluorescent-green-194.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-875-sheet-labels-fluorescent-green-470.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/6-78-x-4-75-sheet-labels-fluorescent-green-815.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17281 pages (at 32 pages/min), scraped 8620 items (at 18 items/min) 2025-11-15 17:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-9-sheet-labels-fluorescent-pink-615.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/7-5-x-5-125-sheet-labels-fluorescent-green-823.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-25-x-0-75-sheet-labels-fluorescent-green-869.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-fluorescent-green-136.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-1-sheet-labels-fluorescent-green-54.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-4375-sheet-labels-fluorescent-yellow-86.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/1-5-x-1-875-sheet-labels-fluorescent-green-470.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-52-x-4-52-sheet-labels-fluorescent-yellow-155.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/6-78-x-4-75-sheet-labels-fluorescent-green-815.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-9-sheet-labels-fluorescent-pink-615.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/7-5-x-5-125-sheet-labels-fluorescent-green-823.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-5-sheet-labels-fluorescent-orange-10.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-5-x-1-sheet-labels-fluorescent-green-54.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-4375-sheet-labels-fluorescent-yellow-86.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17303 pages (at 22 pages/min), scraped 8630 items (at 10 items/min) 2025-11-15 17:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-52-x-4-52-sheet-labels-fluorescent-yellow-155.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/6-78-x-4-75-sheet-labels-fluorescent-green-815.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-25-x-5-5-sheet-labels-fluorescent-orange-205.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17334 pages (at 31 pages/min), scraped 8643 items (at 13 items/min) 2025-11-15 17:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17373 pages (at 39 pages/min), scraped 8663 items (at 20 items/min) 2025-11-15 17:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG2515APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=E*0433*245*X*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0400*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17413 pages (at 40 pages/min), scraped 8684 items (at 21 items/min) 2025-11-15 17:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S405WX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-1-core-brown-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4065 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-1-thermal-transfer-labels-3-core-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG2515APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=E*0433*245*X*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDF4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-3-direct-thermal-labels-freezer.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17442 pages (at 29 pages/min), scraped 8697 items (at 13 items/min) 2025-11-15 17:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-1-thermal-transfer-labels-3-core-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-nonperforated-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSC0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDF4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDF4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDPF4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-1-thermal-transfer-labels-3-core-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-nonperforated-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17468 pages (at 26 pages/min), scraped 8710 items (at 13 items/min) 2025-11-15 17:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3510AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4050A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17504 pages (at 36 pages/min), scraped 8727 items (at 17 items/min) 2025-11-15 17:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-labels-3-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4050A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-13-thermal-transfer-labels-3-core-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/0-5-x-1-75-sheet-labels-blockout-183.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-13-thermal-transfer-labels-3-core-nonperforated-fluorescent-green-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17529 pages (at 25 pages/min), scraped 8742 items (at 15 items/min) 2025-11-15 17:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-83-x-1-375-sheet-labels-blockout-839.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-labels-3-core-chartreuse.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-5-thermal-transfer-labels-3-core-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/8-375-x-11-sheet-labels-white-matte-litho-93.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:38 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17561 pages (at 32 pages/min), scraped 8758 items (at 16 items/min) 2025-11-15 17:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17600 pages (at 39 pages/min), scraped 8779 items (at 21 items/min) 2025-11-15 17:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 17:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17639 pages (at 39 pages/min), scraped 8797 items (at 18 items/min) 2025-11-15 18:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17677 pages (at 38 pages/min), scraped 8815 items (at 18 items/min) 2025-11-15 18:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17715 pages (at 38 pages/min), scraped 8835 items (at 20 items/min) 2025-11-15 18:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17755 pages (at 40 pages/min), scraped 8856 items (at 21 items/min) 2025-11-15 18:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17794 pages (at 39 pages/min), scraped 8875 items (at 19 items/min) 2025-11-15 18:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17836 pages (at 42 pages/min), scraped 8895 items (at 20 items/min) 2025-11-15 18:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-33-sheet-labels-fluorescent-pink-50.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-25-x-2-75-sheet-labels-fluorescent-pink-170.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-fluorescent-pink-420.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-fluorescent-pink-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17869 pages (at 33 pages/min), scraped 8912 items (at 17 items/min) 2025-11-15 18:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/3-x-3-sheet-labels-fluorescent-green-201.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/2-6875-x-2-sheet-labels-fluorescent-green-360.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17902 pages (at 33 pages/min), scraped 8928 items (at 16 items/min) 2025-11-15 18:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:11 [scrapy.extensions.logstats] (PID: 57) INFO: Crawled 17940 pages (at 38 pages/min), scraped 8947 items (at 19 items/min) 2025-11-15 18:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 57) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-15 18:09:06 [scrapy.core.engine] (PID: 57) INFO: Closing spider (finished) 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] ------------------------------ MONITORS ------------------------------ 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] Extracted Items Monitor/test_stat_monitor... OK 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.) 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] Error Count Monitor/test_stat_monitor... FAIL 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] Warning Count Monitor/test_stat_monitor... FAIL 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... OK 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] Unwanted HTTP codes monitor/Should not hit the limit of unwanted http status... OK 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] Field Coverage Monitor/test_check_if_field_coverage_rules_are_met... OK 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount... OK 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] Downloader Exceptions monitor/test_stat_monitor... OK 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] Successful Requests monitor/Should have at least the minimum number of successful requests... OK 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] Total Requests monitor/Should not hit the total limit of requests... OK 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] ---------------------------------------------------------------------- 2025-11-15 18:09:07 [smith_corona] (PID: 57) ERROR: [Spidermon] ====================================================================== FAIL: Error Count Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'log_count/ERROR' to be '<=' to '7.0'. Current value: '30' 2025-11-15 18:09:07 [smith_corona] (PID: 57) ERROR: [Spidermon] ====================================================================== FAIL: Warning Count Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'log_count/WARNING' to be '<=' to '1000.0'. Current value: '9695' 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] 11 monitors in 0.005s 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] FAILED (failures=2, skipped=1) 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] -------------------------- FINISHED ACTIONS -------------------------- 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] ---------------------------------------------------------------------- 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] 0 actions in 0.000s 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] OK 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] --------------------------- PASSED ACTIONS --------------------------- 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] ---------------------------------------------------------------------- 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] 0 actions in 0.000s 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] OK 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] --------------------------- FAILED ACTIONS --------------------------- 2025-11-15 18:09:07 [spidermon.contrib.actions.slack] (PID: 57) WARNING: bot cannot finder user in slack org member list - default icon url used 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] CustomTemplateSendSlackMessageSpiderFinished... OK 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] ---------------------------------------------------------------------- 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] 1 action in 0.555s 2025-11-15 18:09:07 [smith_corona] (PID: 57) INFO: [Spidermon] OK 2025-11-15 18:09:08 [scrapy.extensions.feedexport] (PID: 57) INFO: Stored bq feed (971 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:9 2025-11-15 18:09:08 [scrapy.statscollectors] (PID: 57) INFO: Dumping Scrapy stats: {'HeadersSpooferDownloaderMiddleware/spoofed': 18687, 'NotFoundHandlerSpiderMiddleware/HttpError': 30, 'big_query/url': 9002, 'downloader/exception_count': 1, 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 1, 'downloader/request_bytes': 15501684, 'downloader/request_count': 18687, 'downloader/request_method_count/GET': 18687, 'downloader/response_bytes': 992828428, 'downloader/response_count': 18686, 'downloader/response_status_count/200': 17945, 'downloader/response_status_count/301': 1, 'downloader/response_status_count/403': 740, 'dupefilter/filtered': 1, 'elapsed_time_seconds': 28435.840167, 'feedexport/success_count/BigQueryFeedStorage': 9, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2025, 11, 15, 18, 9, 7, 14950, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 7811900787, 'httpcompression/response_count': 17945, 'httperror/response_ignored_count': 30, 'httperror/response_ignored_status_count/403': 30, 'item_scraped_count': 8971, 'items_per_minute': None, 'log_count/ERROR': 32, 'log_count/INFO': 554, 'log_count/WARNING': 9696, 'memusage/max': 256569344, 'memusage/startup': 125947904, 'poet/injector/catalog_extraction.pages.smith_corona.SmithCoronaSingleProductPageObject': 8973, 'proxy_manager/ignored/proxy_defined': 712, 'proxy_manager/processed': 17975, 'request_depth_max': 1, 'response_received_count': 17975, 'responses_per_minute': None, 'retry/count': 711, 'retry/max_reached': 30, 'retry/reason_count/403 Forbidden': 710, 'retry/reason_count/scrapy.core.downloader.handlers.http11.TunnelError': 1, 'scheduler/dequeued': 18687, 'scheduler/dequeued/memory': 18687, 'scheduler/enqueued': 18687, 'scheduler/enqueued/memory': 18687, 'spidermon/validation/fields': 188391, 'spidermon/validation/items': 8971, 'spidermon/validation/validators': 1, 'spidermon/validation/validators/item/jsonschema': True, 'spidermon_field_coverage/dict/brand': 1.0, 'spidermon_field_coverage/dict/categories': 1.0, 'spidermon_field_coverage/dict/countryOfOrigin': 1.0, 'spidermon_field_coverage/dict/description': 1.0, 'spidermon_field_coverage/dict/imageUrl': 1.0, 'spidermon_field_coverage/dict/inStock': 1.0, 'spidermon_field_coverage/dict/isFreeShipping': 1.0, 'spidermon_field_coverage/dict/leadTime': 1.0, 'spidermon_field_coverage/dict/manufacturer': 1.0, 'spidermon_field_coverage/dict/manufacturerSku': 1.0, 'spidermon_field_coverage/dict/name': 1.0, 'spidermon_field_coverage/dict/packagingIncrement': 1.0, 'spidermon_field_coverage/dict/prices': 1.0, 'spidermon_field_coverage/dict/productStatus': 1.0, 'spidermon_field_coverage/dict/relatedSkus': 1.0, 'spidermon_field_coverage/dict/specifications': 1.0, 'spidermon_field_coverage/dict/supplier': 1.0, 'spidermon_field_coverage/dict/supplierSku': 1.0, 'spidermon_field_coverage/dict/uom': 1.0, 'spidermon_field_coverage/dict/url': 1.0, 'spidermon_field_coverage/dict/weight': 1.0, 'spidermon_item_scraped_count': 8971, 'spidermon_item_scraped_count/dict': 8971, 'spidermon_item_scraped_count/dict/brand': 8971, 'spidermon_item_scraped_count/dict/categories': 8971, 'spidermon_item_scraped_count/dict/countryOfOrigin': 8971, 'spidermon_item_scraped_count/dict/description': 8971, 'spidermon_item_scraped_count/dict/imageUrl': 8971, 'spidermon_item_scraped_count/dict/inStock': 8971, 'spidermon_item_scraped_count/dict/isFreeShipping': 8971, 'spidermon_item_scraped_count/dict/leadTime': 8971, 'spidermon_item_scraped_count/dict/manufacturer': 8971, 'spidermon_item_scraped_count/dict/manufacturerSku': 8971, 'spidermon_item_scraped_count/dict/name': 8971, 'spidermon_item_scraped_count/dict/packagingIncrement': 8971, 'spidermon_item_scraped_count/dict/prices': 8971, 'spidermon_item_scraped_count/dict/productStatus': 8971, 'spidermon_item_scraped_count/dict/relatedSkus': 8971, 'spidermon_item_scraped_count/dict/specifications': 8971, 'spidermon_item_scraped_count/dict/supplier': 8971, 'spidermon_item_scraped_count/dict/supplierSku': 8971, 'spidermon_item_scraped_count/dict/uom': 8971, 'spidermon_item_scraped_count/dict/url': 8971, 'spidermon_item_scraped_count/dict/weight': 8971, 'start_requests/big_query': 9002, 'start_time': datetime.datetime(2025, 11, 15, 10, 15, 11, 174783, tzinfo=datetime.timezone.utc)} 2025-11-15 18:09:08 [scrapy.core.engine] (PID: 57) INFO: Spider closed (finished)